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TITLE OF THE INVENTION 
X-RAY DIAGNOSTIC APPARATUS AND IMAGE PROCESSOR 
CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is based upon and claims the 
5 benefit of priority from the prior Japanese Patent 

Application No. 2001-062031, filed March 26, 2001, the 
entire contents of which are incorporated herein by 
reference . 

BACKGROUND OF THE INVENTION 
10 1. Field of the Invention 

The present invention relates to an X-ray 
diagnostic apparatus and image processor. 
2. Description of the Related Art 
When a moving image is displayed by continuously 
15 displaying a plurality of images, the moving image may 

be observed while a region to be observed (to be 
referred to as a "region of interest" hereinafter) 
moves laterally in the image. When images sensed by 
rotating an imaging system or target are used, in 
20 particular, if the target is not located in the 

rotation center, the target is displayed together with 
its lateral movement. 

It is known that one of the human characteristics 
is that the power of observation/concentration of an 
25 object varies depending on whether the object is 

largely moving or not. If, therefore, a moving image 
with a region of interest largely moving is observed, 
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the power of observation/concentration of the region of 
interest inevitably decreases, resulting in a 
deterioration in operation efficiency or diagnostic 
ability. 

5 The present invention has been made in 

consideration of the above situation, and has as its 
object to provide an image display apparatus and X-ray 
diagnostic apparatus which always display a region of 
interest in an image center to allow an operator to 

10 observe the region of interest while keeping the power 

of observation or concentration high. 

BRIEF SUMMARY OF THE INVENTION 
To achieve this object, according to an aspect of 
the present invention, there is provided an X-ray 

15 diagnostic apparatus comprising: a designating section 

which designates a region of interest on not less than 
one image of a plurality of X-ray diagnostic images 
forming a moving image, when continuously displayed, on 
the basis of an input from an operator, a position 

20 estimating section which estimates corresponding 

regions on the remaining images of the plurality of 
images which correspond to the region of interest, and 
an image processing section which shifts the region of 
interest and the respective corresponding regions to 

25 appropriate positions on the respective images. 

To achieve this object, according to another 
aspect of the present invention, there is provided an 



X-ray diagnostic apparatus comprising: a memory which 
stores a plurality of 2D images forming a moving image 
of a predetermined diagnosis target when continuously 
displayed and a 3D image of the predetermined diagnosis 
target, a designating section which allows an operator 
to designate a region of interest on the 3D image, a 
position estimating section which estimates corre- 
sponding regions on the plurality of 2D images which 
correspond to the region of interest on the basis of a 
position of the region of interest designated on the 3D 
image, and an image processing section which shifts the 
corresponding regions to appropriate positions on the 
respective 2D images. 

To achieve this object, according to another 
aspect of the present invention, there is provided an 
image processor comprising: a memory which stores a 
plurality of images forming a moving image when 
continuously displayed, a designating section which 
allows an operator to designate a region of interest on 
not less than one of the plurality of images, a 
position estimating section which estimates corre- 
sponding regions on the remaining images of the 
plurality of images on the basis of a position of the 
designated region of interest, and an image processing 
section which shifts the region of interest and the 
respective corresponding regions to appropriate 
positions on the respective images. 
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To achieve this object, according to another 
aspect of the present invention, there is provided an 
image processor comprising: a memory which stores a 
plurality of 2D images forming a moving image of a 
5 predetermined diagnosis target when continuously 

displayed, and a 3D image of the predetermined 
diagnosis target, a designating section which allows an 
operator to designate a region of interest on the 3D 
image, a position estimating section which estimates 

10 corresponding regions on the plurality of 2D images 

which correspond to the region of interest on the basis 
of a position of the region of interest designated on 
the 3D image, and an image processing section which 
shifts the respective corresponding regions to 

15 appropriate positions on the respective 2D images. 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 
FIG. 1 is a block diagram showing the schematic 
arrangement of an X-ray diagnostic apparatus 10 
according to an embodiment of the present invention; 

20 FIG. 2 is a perspective view showing the outer 

appearance of the X-ray diagnostic apparatus 10; 

FIG. 3A is a view schematically showing a 
plurality of DSA images of a blood vessel which are 
obtained by 360° rotational imaging, and FIG. 3B is a 

25 view schematically showing the form of a diagnosis 

target when the plurality of DSA images shown in 
FIG. 3A are continuously displayed; 



5 



FIG. 4A is a view schematically showing a 
plurality of DSA images obtained by 360° rotational 
* imaging with a blood vessel as a diagnosis target not 

being located in the image center of each of the group 
5 of images, and FIG. 4B is a view schematically showing 

the form of a diagnosis target when the plurality of 

U 

q DSA images shown in FIG. 4A are continuously displayed; 

a 

,f\ FIG. 5 is a flow chart showing the flow of X-ray 



Q 



shift processing; 

FIG. 6 is a view for explaining an epipolar line 
and position estimation processing; 

FIG. 7 is a block diagram showing the schematic 
arrangement of an image processor 60 according to the 



m 
o 

ry first embodiment; 



FIG. 8A is a view showing a state where the 
coronary artery is dilated with heartbeat, and FIG. 8B 
is a view showing a state where the coronary artery is 
constricted with heartbeat; 

FIG. 9A is a view showing a state where the 
diaphragm moves upward with respiration, and FIG. 9B is 
a view showing a state where the diaphragm moves 
downward with respiration; 

FIG. 10 is a flow chart showing a procedure for 
shift processing executed by the X-ray diagnostic 
apparatus or image processor according to the third 
embodiment; 

FIG. 11 is a view for explaining correlation value 
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computation; 

FIG. 12 is a flow chart showing a procedure for 
shift processing executed by an X-ray diagnostic 
apparatus or image processor according to the fourth 
5 embodiment ; 

FIG. 13 is a conceptual view for explaining shift 
processing executed by the X-ray diagnostic apparatus 
or image processor according to the fourth embodiment ; 

FIG. 14 is a conceptual view for explaining shift 
10 processing executed by the X-ray diagnostic apparatus 

or image processor according to the fourth embodiment; 

FIG. 15 is a view showing an example of an X-ray 
image displayed on a TV monitor 42 with a region of 
interest being designated; 
15 FIG. 16 is a view showing a region of interest 

enlarged according to the screen size of the TV 
monitor 42; 

FIG. 17 is a view showing an example of an X-ray 
image displayed on the TV monitor 42 with a rotation 
20 center P being designated; 

FIG. 18 is a view showing a region of interest 
enlarged according to the screen size of the TV monitor 
42; and 

FIG. 19 is a view schematically showing a blood 
25 vessel displayed as a moving image when a square is 

selected. 



DETAILED DESCRIPTION OF THE INVENTION 
The first to fifth embodiments of the present 
invention will be described below with reference to the 
views of the accompanying drawing. Note that the same 
reference numerals denote constituent elements having 
the same functions and arrangements throughout the 
views of the accompanying drawing, and a repetitive 
description will be made only when required. 
(FIRST EMBODIMENT) 

In the first embodiment, the technical idea of the 
present invention is applied to an X-ray diagnostic 
apparatus . 

FIG. 1 is a view showing the schematic arrangement 
of an X-ray diagnostic apparatus 10 according to the 
present invention. FIG. 2 is a view showing part 
of the outer appearance of the X-ray diagnostic 
apparatus 10. 

As shown in FIG. 1, the X-ray diagnostic apparatus 
10 includes a high voltage generator 11, X-ray 
generating section 12, X-ray detector 14, C-arm type 
holder 16, high voltage generator I/F 20, diaphragm I/F 
22, detector I/F 24, C-arm I/F 26, CPU 28, 3D image 
creating section 29, image memory 30, position 
detecting section 32, LUT 34, AFFINE transformation 
section 36, video signal conversion section 38, input 
unit 40, and TV monitor 42. 

The high voltage generator 11 is an apparatus for 



applying a high voltage to the X-ray generating section 
12, and is comprised of a high-voltage transformer, 
filament heating converter, rectifier, high-voltage 
switch, and the like. 

The X-ray generating section 12 includes an X-ray 
tube 121 for irradiating an object with X-rays and an 
X-ray stop unit 123 for collimating the X-rays emitted 
from the X-ray tube 121. The X-ray tube 121 is a 
vacuum tube for generating X-rays. The X-ray tube 121 
generates X-rays by accelerating electrons using a high 
voltage generated by the high voltage generator 11 and 
making the electrons collide with a target. The X-ray 
stop unit 123 is placed between the X-ray tube 121 and 
the object to narrow the X-ray beam sent from the X-ray 
focus of the X-ray tube to a desired image reception 
size. For example, X-rays are narrowed to prevent 
unnecessary exposure of the object to X-rays or make a 
displayed image look more clearly in a diagnosis by the 
X-ray diagnostic apparatus. 

The X-ray detector 14 is comprised of an X-ray 
plane detector which is relatively thin and has a flat 
detection surface or an I.I. (Image Intensifier) , an 
optical system, and the like. The X-ray plane detector 
generates electron holes by causing X-rays transmitted 
through the object to strike a photoelectric film, 
stores the holes in a semiconductor switch, and reads 
them as an electrical signal, thereby detecting an 
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X-ray signal. The I.I. converts X-rays transmitted 

through the object into optical information through an 
* input phosphor screen, and causes the photoelectrons 

generated on the basis of the optical information to 
5 collide with an output phosphor screen, thereby 

creating a high-luminance optical image. 
I'll The X-ray generating section 12 and X-ray detector 

s 

|3 14 are fixed/held on the two end portions of a C-arm 

%l 160 to oppose each other (see FIG. 2) . 

fn 10 The C-arm type holder 16 is comprised of the C-arm 

%i 160, a holder 162 for slidably holding the C-arm 160, 

and a holder support portion 164 for holding the holder 
5 162 (see FIG. 2) . 

The X-ray generating section 12 is mounted on one 
15 end of the C-arm 160, and the X-ray detector 14 is 

mounted on the other end. These two components are 
fixed/held to oppose each other through the object (see 
FIG. 1) . A rail is attached to the back surface or a 
side surface of the C-arm 160. The C-arm 160 can slide 
20 on the rail by clamping it between rollers mounted on 

the holder 162. With this structure, an X-ray image at 
an arbitrary optical axis angle can be acguired. 

The high voltage generator I/F 20 is an interface 
for transferring a control signal from the CPU 28 which 
25 is used to generate X-rays to the high voltage 

generator 11. 

The diaphragm I/F 22 converts control signals 
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associated with operation of the stop and its moving 
operation from the CPU 28 into a predetermined signal 
sequence, and transmits it to the X-ray stop unit 123. 
The diaphragm I/F 22 also transmits position 
5 information from the rotating mechanism portion of the 

X-ray stop unit 123 to the CPU 28. 

The detector I/F 24 receives digital fluoroscopic 
image data converted into digital data by the X-ray 
detector 14, and transfers it to the 3D image creating 
10 section 29, image memory 30, and the like. 

if 

•3 The detector I/F 24 also converts control signals 

© associated with detecting operation/moving operation 

ffl 

£i from the CPU 28 into a predetermined signal sequence, 

111 

and transmits it to the X-ray stop unit 123. 
15 The diaphragm I/F 22 transmits position 

information from the rotating mechanism portion of the 

X-ray detector 14 to the CPU 28. 

The CPU 28 performs control associated with 

acquisition of X-ray fluoroscopic image data and 
20 control associated with image processing of acquired 

image data. 

The 3D image creating section 29 receives digital 
f luoroscopic/sensed image data from the detector I/F 
24, and performs predetermined image processing, 
25 thereby creating a predetermined X-ray diagnostic image 

(e.g., mask image, contrast image, or subtraction 
image) . The 3D image creating section 29 also creates 
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voxel volume data on the basis of a plurality of X-ray 
diagnostic images, and creates a 3D image on the basis 
of the volume data. 

The image memory 30 is a storage section for 
storing X-ray diagnostic image data for each frame, 
voxel volume data, and 3D images or storing a plurality 
of X-ray diagnostic image data sensed by other 
apparatuses . 

The position detecting section 32 performs, for 
example, estimation associated with a predetermined 
position on an X-ray diagnostic image in the form to be 
described later on the basis of information such as the 
detector size, the angle of the C-arm 160, and SID (the 
distance between the X-ray source of the X-ray 
generating section 12 and the X-ray detector 14) . 

The LUT (Look Up Table) 34 performs grayscale 
conversion in advance on the basis of a conversion 
correspondence table of input values and output values. 

The AFFINE transformation section 36 performs 
translation, enlargement, reduction, rotation, and the 
like (i.e., affine transformation) with respect to a 
display image. Note that the operation of moving a 
display image in the affine transformation will be 
referred to as "shift" hereinafter. 

The processing executed by the AFFINE 
transformation section 36 and position detecting 
section 32 may be implemented by the CPU 28. 
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The video signal conversion section 38 converts an 
input signal sequence of X-ray fluoroscopic image data 
into a raster signal sequence in a video format. 

The input unit 4 0 includes a keyboard, various 
switches, a mouse, and the like, and is used to select 
an image or input position information (to be described 
later) . 

The TV monitor 42 displays the reconstructed 
fluoroscopic image data created by the position 
detecting section 32. 

X-ray image shift processing and image display 
after the X-ray image shift processing which are 
executed by the X-ray diagnostic apparatus 10 will be 
described next with reference to the views of the 
accompanying drawing. 

(Moving Image Display before Shift Processing) 

A case where images obtained by rotational imaging 
and stored in the image memory 30 are continuously 
displayed on the TV monitor 42 without performing shift 
processing (that is, a normal rotational display form) 
will be described first. This rotational imaging is an 
imaging method of performing imaging while rotating an 
imaging system or object. In the case of the X-ray 
diagnostic apparatus 10 for circulatory organs, this 
method is an imaging method of acquiring a plurality of 
X-ray images by performing imaging while rotating 
substantially the C-arm 160. 



- 13 - 



In observing a plurality of images that are 
continuously displayed, continuous image display that 
can be observed in a form in which it looks as if a 
diagnosis object were moving (e.g., regular or 
5 irregular movement, vibration, or rotation) is 

sometimes called "moving image display". According to 
this moving image display, in a case where, for 
example, DSA images of a blood vessel which are 
associated with rotational imaging are continuously 

10 displayed, the blood vessel can be displayed in the 

form in which it looks as if the blood vessel were 
rotated/moved (to be referred to as pseudo-rotational 
display" hereinafter, that is, "pseudo-rotational 
display" is special operation of "moving image 

15 display" ) . 

FIG. 3A schematically shows a plurality of DSA 
images (Digital Subtraction Angiography images) of a 
blood vessel which are obtained by 360° rotational 
imaging. 

20 When the DSA images shown in FIG. 3A are 

sequentially displayed from images a to z on the TV 
monitor 42 at predetermined time intervals, an observer 
can observe a blood vessel in the form in which it 
looks as if the blood vessel rotated about the image 

25 center. 

In this case, in order to properly realize the 
above pseudo-rotational display, it is important to 
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locate a diagnosis object as a rotation target in the 
center of an image. That is, in pseudo-rotational 
display, since a plurality of DAS images associated 
with rotational imaging are continuously displayed, if 
5 the diagnosis object (a blood vessel with a contrast 

medium in FIG. 3) displayed on each DAS image is not 

r\ 

pi located in the image center, the diagnosis target 

ill 

displayed in the form in which it looks as if the 

<taf 

|f. target were moved vertically and horizontally. 

10 FIG. 4A schematically shows a plurality of DSA 

'S J images obtained by 360° rotational imaging, which are a 

w 

Q group of images with a blood vessel as a diagnosis 

f 

Q target not being located in the center of each image. 

w 

When the DSA images shown in FIG. 4A are 
15 sequentially displayed, from images A to E, on the TV 

monitor 42 at predetermined time intervals, the 
observer observes that the blood vessel rotates about 
the image center, as shown in, for example, FIG. 4B. 
As a consequence, the power of observation and 
20 concentration inevitably decrease, resulting in a 

deterioration in work efficiency or diagnostic ability. 
(X-ray Image Shift Processing) 

X-ray image shift processing executed by the X-ray 
diagnostic apparatus 10 according to the present 
25 invention to perform proper pseudo rotational display 

will be described with reference to FIG. 5. This X-ray 
image shift processing is performed to move a region of 
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interest of each display image to a desired position 
(to be referred to as an "appropriate position" 
hereinafter) on the image. 

Note that the "region of interest" is a 
5 predetermined region in an image (e.g., a DSA image) to 

be rotated/displayed by the observer at a predetermined 
position on the image. An appropriate position may be 
set at any position on an image. For the sake of 
simple explanation, assume that an appropriate position 

10 is the center of an image in the following description. 

In this case, the rotation center of pseudo rotational 
display coincides with a region of interest. 

FIG. 5 is a flow chart showing the flow of X-ray 
image shift processing. 

15 Referring to FIG. 5, if a diagnosis target moves 

within an image once pseudo rotational display is 
performed, the input unit 40 is operated to turn on a 
"Centering" button (step SI) . With this processing, 
this apparatus shifts to the shift processing execution 

20 mode. 

The flow then advances to step S2 for the 
designation of a region of interest. In this step, the 
following processing is performed. Note that as a 
region of interest in this embodiment, a region having 
25 almost the same size as that of a tumor formed in a 

blood vessel or the like may be conceivable. Since a 
region of interest serves as a reference for shift 
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processing as described later, even a point (e.g., one 
point designated by a cursor) may effect the same 
object. For the sake of simplicity, assume that in 
step S2, one point is designated as a region of 
5 interest. 

First of all, of a plurality of DSA images 
obtained by rotational imaging, for example, the first 
frame image (the frame image sensed for the first time) 
and the frame image nearest to the first frame image at 

10 a vertical angle are displayed side by side. For 

example, in FIG. 4A, a combination of the first frame 
image and the image A or a combination of the images A 
and B may be conceivable. 

Subseguently, for example, a region of interest on 

15 the image A is designated first by using the input unit 

40. As a consequence, an epipolar line L based on the 
region of interest on the image A is displayed on the 
image B displayed beside the image A. 

FIG. 6 is a view for explaining an epipolar line 

20 and position estimation processing (to be described 

later) . Referring to FIG. 6, reference symbol PI 
denotes a region of interest designated on the image A; 
P2, a region of interest designated on the image B; and 
V, a blood vessel (aneurysm) as a diagnosis target. 

25 Referring to FIG. 6, consider a line connecting 

the region PI of interest on the image A and the focal 
position of the X-ray tube 121 in sensing the image A. 
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The line L obtained by projecting this straight line 
on the image B by using the X-ray tube 121 located at 
the position where the frame image B is sensed is the 
epipolar line L associated with the straight line L^. 
5 As a region of interest on the image B, the 

predetermined position P2 on the epipolar line L is 
designated. This is because an aneurysm as a diagnosis 
target is always located on the epipolar line L. 

The position detecting section 32 then performs 

10 processing for estimating the position of a region of 

interest on each of the remaining DSA images (step S3) . 
For example, this position estimation processing is 
executed as follows on the basis of at least one of 
each region of interest designated on each of the frame 

15 image described above, SID, image-receiving surface 

size, and angle information of the C-arm 160 for each 
DSA image, and the like. 

First of all, as shown in FIG. 6, the position 
detecting section 32 calculates a straight line Lg 

20 connecting the region P2 of interest on the image B and 

the focal position of the X-ray tube 121 in sensing the 
image B, and also calculates an intersecting point C of 
the straight line and the straight line Lg. This 
intersecting point C corresponds to the 3D position of 

25 a diagnosis target (aneurysm) actually existing in the 

object. Although an intersecting point is obtained in 
this case, no intersecting point actually exists due to 
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a designation error or the like in many cases. In such 
a case, an intersecting point is calculated as the 
midpoint between points nearest to the straight lines 
and Lg. 

5 The position detecting section 32 then projects 

the intersecting point C on each DSA image by obtaining 
a straight line connecting the intersecting point C and 
G [ the focal position of the X-ray tube 121 in sensing 

£1 each image. The projection position of the 

J* 10 intersecting point C becomes a position estimated as a 

m 

region of interest on each of the remaining DSA images. 

© 

(4! The pieces of region-of-interest information on the 

O 

rp respective DSA images, obtained m this manner, are 

Q 

ry automatically transferred as a position table (the 

15 positions of the regions of interest on the first frame 

image to the last frame image) to the AFFINE 
transformation section 36. 

The AFFINE transformation section 36 performs 
AFFINE transformation for the respective DSA images to 
20 shift the regions of interest to the image centers on 

the basis of the above position table (step S4). As a 
consequence, for example, the DSA images in the form 
shown in FIG. 4A can be converted into images with the 
regions of interest shifted to the image centers as 
25 shown in FIG. 3A by this AFFINE transformation 

processing. 

The respective DSA images after shift processing 
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are continuously displayed on the TV monitor 42 after 
they undergo grayscale conversion by the LUT 34 
(step S5) . 

In this embodiment, only the rotational imaging by 
5 the X-ray apparatus is described. However, the present 

invention is not limited to this, and includes images 

u 

Q sensed by any rotational imaging system. 

m 

>£) In the X-ray diagnostic apparatus described above, 

%l of a plurality of still images forming a moving image 

<f 

£ff 10 when continuously displayed, desired regions (e.g., 

q regions of special interest) are specified with respect 

jwi to some (at least two) of the images. With respect to 



m 
in 



the remaining images, corresponding regions which 
correspond to the regions of interest are estimated by 
geometrical calculation or the like, and the region of 
interest or corresponding region on each image is then 
shifted to a corresponding image center. If, 
therefore, images after shift processing are 
continuously displayed, the region of interest is 
always displayed in the image center. This therefore 
eliminates the necessity to shift the viewpoint. As a 
result, the observer can observe the region of interest 
with the power of observation or concentration being 
kept high. 
(SECOND EMBODIMENT) 

In the second embodiment, the present invention is 
applied to a general image processor (including an 
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apparatus incorporated in a medical image diagnostic 
apparatus) . This embodiment greatly differs from the 
first embodiment in a method of estimating a region of 
interest. In the first embodiment, since the present 
invention is applied to an X-ray diagnostic apparatus 
and an image processor incorporated therein, a region 
of interest on each DSA image can be estimated on the 
basis of information associated with an imaging system 
(e.g., SID, image-receiving surface size, information 
such as the angle of the C-arm 160, and the like, as 
described above) . In an image processor having no 
special imaging system like an X-ray diagnostic 
apparatus, when the above shift processing is to be 
performed for a plurality of images forming a moving 
image when continuously displayed, position estimation 
must be performed by another method. The second 
embodiment will be described below with particular 
emphasis on position estimation processing. 

FIG. 7 is a view showing the schematic arrangement 
of an image processor 60 according to the second 
embodiment . 

A plurality of still image data constituting a 
moving image are stored in an image memory 30. 

A position detecting section 32 calculates the 
locus drawn by a region of interest in imaging 
operation by using a method to be described later, and 
estimates a region of interest on each image on the 
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basis of the locus. 
(Image Shift Processing) 

Image shift processing which is executed by the 
image processor 60 according to the present invention 
5 to realize appropriate pseudo-rotational display will 

be described next. Note that the flow of image shift 
p processing executed by the image processor 60 is almost 

a 

jj the same as that described with reference to the flow 

!y chart of FIG. 5, and hence will be described below with 

10 reference to FIG. 5. 
% % Referring to FIG. 5, if, for example, an 

! i? observation target moves within an image once a moving 

{ f} image is temporarily displayed, a "Centering" button is 

Q 

ill turned on by using an input unit 4 0 (step SI) . With 

15 this processing, this processor shifts to the shift 

processing execution mode. 

The flow then advances to step S2 to designate a 
region of interest, and the following processing is 
performed. 

20 First of all, for example, of all frame images, a 

plurality of frame images selected in advance as 
initial settings, e.g., the first frame, the frame 
image at the 1/3 position in all the images, the frame 
image at the 2/3 position in all the images, and the 

25 last frame image, are displayed side by side. If, for 

example, a target image group is a group of 180 frame 
images, the first frame image, 60th frame image, 120th 
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frame image, and 18 0th frame image which is the last 
image correspond to the selected images. 

A region of interest is then designated on each of 
the frame images displayed side by side by using the 
5 input unit 40. The position information of the region 

of interest on each image is automatically transferred 
to the position detecting section 32. 

The position detecting section 32 calculates the 
locus of each region of interest in imaging operation 

10 on the basis of the position information, and 

calculates the position of a region of interest on each 
of the remaining frame images, on which no region of 
interest has been designated, by interpolation, thereby 
executing position estimation processing (step S3) . 

15 The pieces of position information about the 

regions of interest on the respective images which are 
calculated by this calculation are complied as a 
position table (the positions of the regions of 
interest of the first frame to the last frame) and 

20 transferred to an AFFINE transformation section 36. 

Note that the above regions of interest may be 
calculated by using a method of obtaining a function 
that is satisfied by each region of interest designated 
by, for example, a high-order approximate function 

25 (e.g., a cubic Spline), B-Spline function, or Bezeir 

function . 

The AFFINE transformation section 36 then performs 
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AFFINE transformation for each image to shift the 
region of interest to the image center on the basis of 
the position table described above (step S4) . As a 
consequence, if the respective DSA images before the 
5 shift processing are in the form shown in FIG. 4A, 

images with regions of interest shifted to the image 
centers as shown in FIG. 3A can be obtained by the 
AFFINE transformation. 

The respective DSA images after the shift 

10 processing are subjected to grayscale conversion in a 

LUT 34 and then continuously displayed on a TV monitor 
42 (step S5) . 

With the above shift processing, an arbitrary 
motion can be displayed with a region of interest being 

15 always located in the image center. This makes it 

possible to observe diagnostic images while keeping the 
power of observation or concentration high. 
(Example 1) 

A specific example of clinical application of an 
20 image processor 60 according to this embodiment will be 

described next. 

For example, in some case, motion caused by 
heartbeat makes it difficult to observe a coronary 
artery constriction (narrowing of a valve of a blood 
25 vessel) or the like. 

FIGS. 8A and 8B are views showing two of a 
plurality of diagnostic images of the coronary artery 
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which are sensed without moving an imaging system and 
the observation target. FIG. 8A shows a state where 
the coronary artery is dilated by heartbeat. FIG. 8B 
shows a state where the coronary artery is constricted 
by heartbeat. An example of facilitating observation 
of the constriction of the moving coronary artery by 
shift processing performed by the image processor 60 
will be described with reference to FIGS. 8A and 8B. 

Since the coronary artery (cardiac blood vessel) 
moves in synchronism with heartbeat, the position of a 
region of interest (xl(t), yl(t)) on each image is 
estimated by the following function in this embodiment. 

.... v 1 2rcnt , 2unt 
xl(t) = aO + > an cos + > bnsm 

n=l n=0 

(1) 

..... _ , ^ 27rnt . 27int 

yl(t) = cO + > cn cos -f > dn sin 

~ Tl ^ n Tl 

n=l n = 0 

where Tl is the period of heartbeat, which can be 

obtained from an electrocardiogram. In addition, in 

this embodiment, for the sake of simplicity, the case 

of N = 1 will be considered. 

Mathematical expression (1) has six unknowns, 

i.e., aO, al, bl, cO, cl, and dl when N = 1. 

Mathematical expression (1) can be uniquely determined 

and each region of interest can be grasped as a 

function of time t by providing the coordinates of 

three regions of interest. That is, the position of a 

region of interest on each image can be estimated by 
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designating regions of interest on three different 
images using an input unit 40. 

Since the locus of a region of interest can be 
grasped as a function of time t, a region of interest 
5 on each image can be estimated in correspondence with 

the time information of each of a plurality of sensed 
diagnostic images. Each estimated region of interest 
is shifted to the image center in accordance with the 
contents described above. 

10 In the above case, in order to determine six 

unknowns, at least the coordinates of three regions of 
interest are provided as necessary information. From 
the viewpoint of precision, however, mathematical 
expression (1) may be uniguely determined on the basis 

15 of the coordinates of more regions of interest. 

(Example 2) 

Another specific example of clinical application 
of an image processor 60 according to this embodiment 
will be described next. 

20 In an attempt to observe a tumor near the 

diaphragm, since the diaphragm moves with respiration, 
the tumor also moves in synchronism with respiration. 
This may make it difficult to observe the tumor. 
FIGS. 9A and 9B are views showing two of a 

25 plurality of diagnostic images of a portion near the 

diaphragm which are sensed without moving an imaging 
system and observation target. FIG. 9A shows a state 
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where the diaphragm moves upward due to respiration. 
FIG. 9B shows a state where the diaphragm moves 
downward due to respiration. An example of 
facilitating observation of the tumor near the 
diaphragm by shift processing performed by the image 
processor 60 when the movement of the tumor due to 
respiration makes it difficult to observe the tumor. 

Since the diaphragm and tumor move in synchronism 
with respiration, the position of a region of interest 
(x2(t), y2(t)) on each image can be estimated by the 
following function in this embodiment. 

27int ^ ^ . 27tnt 

x2(t) = eO + > en cos + > f n sxn 

, T2 , T2 

~, , „ v-> 27int , . 27tnt 

y2(t) = gO + 2_i 9 n cos + 2-i sin 

n=l n=l 

where T2 is the period of respiration. The specific 

value of T2 can be obtained on the basis of the 

movement of the diaphragm in a moving image or the 

value detected by a pressure sensor attached to a 

tourniquet wound around the abdomen of a patient. 

Since mathematical expression (2) has the same 
form as that of mathematical expression (1) , 
mathematical expression (2) can be uniquely determined 
and a region of interest on each image can be estimated 
according to the procedure in Example 1. 
(Modification) 

A modification of the image processor 60 according 
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to this embodiment will be described next. 

(1) According to the above description, the 
number of frame images on which regions of interest are 
designated by the input unit 40 is fixed. It is, 
however, preferable that the number of frame images be 
arbitrarily changed. 

In addition, an approximate function for obtaining 
the locus of a region of interest may be arbitrarily 
selected from a plurality of types of functions. 
According to a selection method in this case, for 
example, a button "FUNCTION" is included in a toolbar 
in a display window, and a plurality of types of 
functions are included in a pull-down menu of the 
button. When a desired function is selected from these 
functions, the function is selected as a position 
estimation function. At this time, the selected 
function is preferably checked on the menu to show the 
operator which function is currently selected as a 
position estimation function at a glance. 

In addition, the number of frame images on which 
regions of interest are designated may be changed in 
accordance with a selected function. This is because 
the necessary minimum number of functions for 
approximation may differ depending on the function 
selected. 

(2) This apparatus may be configured to 
automatically select a function depending on a 



- 28 - 



predetermined function as described next instead of 
manually selecting a desired function as in (1) . 

Assume that when a moving image is displayed in 
the above described manner, the region of interest on a 
5 given image deviates from the image center to result in 

difficulty in observation. In this case, moving image 
display is stopped at the image on which the region of 
interest is displayed at a position deviated from the 
image center, and the position of a region of interest 

10 is designated again on the image. For example, this 

designating operation is performed by designating a 
position while pressing the [SHIFT] key to discriminate 
the operation from the operation of designating a 
normal region of interest. 

15 In response to this operation, a CPU 28 determines 

that the position of a region of interest is added, and 
controls the position detecting section 32 to perform 
position estimation again by using the newly input 
region of interest and all the regions of interest that 

20 have already been input. At this time, if, for 

example, high-order approximation is selected at 
[FUNCTION], a cubic function is switched to a guartic 
function, and the order is sequentially increased if 
designation of a region of interest as a point is 

25 added, thereby performing high-order approximation. 

This makes it possible to determine a specific 
approximate function. 
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The above image processor is configured to specify 
regions of interest on some (at least two) of a 
plurality of still images forming a moving image when 
continuously displayed, estimate corresponding regions 
3 on the remaining images which correspond the regions of 

interest by analytical means or the like, and shift the 
region of interest or corresponding region on each 
image to the image center. If, therefore, images after 
!f! shift processing are continuously displayed, the 

'f? 10 regions of interest are always displayed in the centers 

of the respective images, thereby eliminating the 

Ul necessity to move the viewpoint. As a consequence, the 

G 

;JI observer can observe the region of interest while 

11,1 keeping the power of observation and concentration 

15 high. 

(THIRD EMBODIMENT) 

The third embodiment of the present invention will 
be described next. 

According to the third embodiment, an X-ray 
20 diagnostic apparatus or image processor is designed to 

designate regions of interest on all X-ray diagnostic 
images by one region-of -interest designating operation 
and perform image shift processing. Note that the 
X-ray diagnostic apparatus or image processor according 
25 to this embodiment has the same arrangement as that 

shown in FIG. 1 or 7 . For the sake of a simple 
explanation, assume that 360 images acquired at 1° 
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intervals with a diagnosis target serving as a rotation 
center. 

FIG. 10 is a flow chart showing a procedure for 
shift processing executed by the X-ray diagnostic 
5 apparatus or image processor according to this 

embodiment. As shown in FIG. 10, first of all, the 
"Centering" button is turned on by operating an input 

Q 

'3 unit 40 to shift to the shift processing executing mode 

M (step SI 1 ) . 

Ifl 10 A region of interest is designated on a desired 

Q image by using the input unit 40 (step S2 ' ) . 

Q Correlation value computation associated with 



pixel values between adjacent images is performed on 
the basis of the designated region of interest 
(step S3 ' ) . 

FIG. 11 is a view for explaining the correlation 
value computation in step S3'. Referring to FIG. 11, a 
point Pi on the first image is the region of interest 
designated in step S2'. Letting (x, y) be the 
coordinates of a pixel corresponding to a region of 
interest on the ith image, and Ii(x, y) be the pixel 
value, the correlation value computation in step S3 ' i 
executed between the adjacent images according to 
equation (1) given below. 

Ci+i ( Ax, Ay) 

= JJ{I i (x,y)-I i+1 (x+Ax,y+Ay) }2dxdy (3) 
In this case, the integration interval is defined by 
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(-Aw ^ x ^ Aw,-Aw ^ y =- Aw where Aw is a 
predetermined amount) , i is a natural number defined by 
1 ^ i 360, and Ax and Ay are movement amounts from 
the coordinates (x, y) of the pixel corresponding to 
P-[. This correlation value computation is executed 
among all adjacent images. On the other hand, in the 
modification described later, the correlation value 
computation is executed among a part of the adjacent 
images . 

The position of a region of interest on each image 
is estimated on the basis of each correlation value 
(step S4')- More specifically, in each of the 
remaining images, a position (x + Ax, y + Ay) 
determined by Ax and Ay that minimize a correlation 
value Cj_ + ]_(Ax, Ay) obtained by equation (3) is 
estimated as a position corresponding to the region of 
interest on the first image designated in step S2 ' . 

The pieces of region-of -interest information about 
the respective images obtained in this manner are 
automatically transferred as a position table (the 
positions of the regions of interest on the first frame 
image to the 360th frame image) to an AFFINE 
transformation section 36. The AFFINE transformation 
section 36 performs AFFINE transformation for each DSA 
image to shift the region of interest to the image 
center on the basis of the position table (step S5 1 ). 

The respective images after shift processing are 



- 32 - 



subjected to grayscale conversion in an LUT 34 and 
continuously displayed on a TV monitor 42 (step S6'). 

According to the above description, a region of 
interest is designated on the first image in step S2 ' . 
5 However, the ordinal number of one X-ray image to be 

designated need not be specified. Letting k be the 
image number at which a region of interest is 
designated in step S2 ' , the correlation value 
computation in step S3' is generally expressed by 
10 (i) for i S k 

C i _ 1 ( Ax, Ay) 

=SS{1± (x^yj-li-i (x+Ax,y+Ay) }2dxdy (4) 
(ii) for i > k 
C i+1 ( Ax, Ay) 

15 =iX{I i (x,y)-I i+1 (x+Ax,y+Ay) } 2 dxdy (5) 

The correlation value computation in step S3' is 
not limited to equations (4) and (5). For example, 
this computation may be performed on the basis of the 
normal correlation function obtained by normalizing 

20 equation (3) or the like or the phase correlation 

function obtained by a Fourier transform of 
equation (3) or the like, 
(modification) 

In the above example, the correlation value 

25 computation is executed among all adjacent images. On 

the other hand, from the viewpoint of shortening the 
computation time, the configuration may be adopted as 
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following. That is, the correlation value computation 
is executed among a part of the images which is 
adjacent and corresponding to the pre-registered angle. 
In addition, region of the interest on each of the 
remaining images is estimated in accordance with the 
contents described above. 

For example, it is assumed that the pre-registered 
angle for computation of the correlation value is 10° 
which is from the 0° to the 10°. In this case, a 
region of interest on the image at the 0° is designated 
by using the input device 40. On the other hand, the 
correlation value computation is executed among the 
adjacent images corresponding to 10 frames from the 0° 
to the 10° . 

On the basis of the region of interest designated 
by user on the image at the 0° and the region of 
interest estimated by the computation of the 
correlation value, the 3D position of the region of 
interest can be calculated, for example, by using the 
epipolar line described in the first embodiment. 
Therefore, each of the region of interesting on the 
remaining images can be estimated by projection of the 
3D position of the region of interest on the remaining 
images . 

Note that, in this configuration, it is preferable 
that the pre-registered angle for computation of the 
correlation value is at an angle of 10°~30°, 
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approximately. 

According to the above arrangement, areas of 
interest on all images used for moving image display 
can be designated by designating only a region of 
5 interest on one image. This therefore makes it 

possible to reduce the operation load on the operator 
and improve the operation efficiency. 

If, therefore, images after shift processing are 
continuously displayed, the region of interest is 
10 always displayed in the image center. This therefore 

eliminates the necessity to shift the viewpoint. As a 
result, the observer can observe the region of interest 
with the power of observation or concentration being 
kept high. 
15 ( FOURTH EMBODIMENT) 

The fourth embodiment of the present invention 
will be described next. 

In the fourth embodiment, an X-ray diagnostic 
apparatus or image processor will be described, which 
20 is designed to designate areas of interest on all X-ray 

diagnostic images for moving image display by 
designating a region of interest on a 3D image such as 
a 3D angiogram once and perform image shift processing. 
The arrangement of the X-ray diagnostic apparatus or 
25 image processor according to this embodiment is the 

same as that shown in FIG. 1 or 7 . 

FIG. 12 is a flow chart showing a procedure for 
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shift processing executed by the X-ray diagnostic 
apparatus or image processor according to this 
embodiment. As shown in FIG. 12, first of all, the 
"Centering" button is turned on by operating an input 
unit 40 to shift to the shift processing executing mode 
(step SI") . 

A region of interest is designated on the 3D image 
displayed on a TV monitor 42 by using the input unit 4 0 
(step S2") . As shown in FIG. 13, a voxel corresponding 
to the designated region of interest is specified by a 
position estimating section 32. 

A 3D coordinate system in which voxel data is 
defined is made to correspond to a 2D coordinate system 
in which X-ray images are defined (step S3") . This 
operation of making the 3D coordinate system correspond 
to the 2D coordinate system is executed on the basis of 
at least one of the image-receiving surface size of an 
X-ray detector 14, the angle information of a C-arm 160 
for each DSA image, and the like. 

Subsequently, as shown in FIG. 14, positions on 
all 2D images used for moving image display which 
correspond to the region of interest designated on the 
3D image are estimated (step S4"). This position 
estimation is executed by mapping the region of 
interest designated on the 3D image in all the 2D 
images used for moving image display on the basis of 
the correspondence obtained in step S3". 
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The pieces of region-of-interest information about 
the respective images obtained in this manner are 
automatically transferred as a position table (the 
positions of the areas of interest on the first frame 
5 image to the 360th frame image) to an AFFINE 

transformation section 36. The AFFINE transformation 
section 36 performs AFFINE transformation for each DSA 
image to shift the region of interest to the image 
center on the basis of the position table (step S5") . 

10 The respective images after shift processing are 

subjected to grayscale conversion in an LOT 34 and 
continuously displayed on a TV" monitor 42 (step S6"). 
At this time, if the moving image based on the 2D 
images and the 3D image are simultaneously displayed, 

15 the operator can make an observation more intuitively. 

Note that, in this simultaneous display, it is 
preferable that the moving image based on the 2D images 
and the 3D image are synchronously displayed. In 
addition, the moving image based on the 2D images and 

20 the 3D image are displayed with the same magnifying 

power. These configuration are performed by the 
correspondence between the 3D coordinate system and the 
2D coordinate system. 

According to the above arrangement, areas of 

25 interest can be designated on all images used for 

moving image display by designating a region of 
interest on a 3D image once. This therefore makes it 
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possible to reduce the operation load on the operator 
and improve the operation efficiency. 

In addition, the operator can observe a target 
region in detail by using a 3D image and a moving image 
5 constituted by 2D images. For example, the operator 

can understand the structure of a diagnosis target with 

M 

rf a 3D image and observe a region of interest in detail 

q 

i|| with a moving image . 

O 

ij (FIFTH EMBODIMENT) 

j|l 10 The fifth embodiment of the present invention will 

be described next. An apparatus according to this 
%t embodiment is designed to designate a region as a 

| a; ; region of interest and shift the region to the image 

l V center (i.e., the appropriate position). In this case, 

15 a region of interest and a rotation center for pseudo 

rotational display (to be simply referred to as a 
"rotation center" hereinafter) must be designated. 
(Example 1) 

An example of designating a rotation center after 
20 designating a region of interest on a 2D image will be 

described first with reference to FIGS. 15 and 16. 

A region of interest is designated on an X-ray 
image on a TV monitor 42 through an input unit 40. 
FIG. 15 shows an example of the X-ray image displayed 
25 on the TV monitor 42 with a region of interest 

designated. The region enclosed with the dotted line 
is the designated region of interest. The region of 
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interest that is designated in this manner and has a 
predetermined size is enlarged according to the screen 
size of the TV monitor 42, as shown in FIG. 16. This 
makes it possible to observe the image obtained by 
5 extracting only the region of interest. 

A rotation center P like the one shown in FIG. 16 
is designated on the region of interest enlarged 
according to the screen size of the TV monitor 42. 
Subsequently, areas of interest and rotation 

10 centers P on the remaining images are estimated in 

accordance with the contents described above, and the 
rotation center P is shifted to each image center. If 
the images after shift processing are continuously 
displayed, the region of interest can always be 

15 displayed in the image center. 

(Example 2) 

An example of designating a region of interest 
after designating a rotation center on a 2D image will 
be described next with reference to FIGS. 17 and 18. 

20 First of all, as shown in FIG. 17, a rotation 

center is designed on an X-ray image on a TV monitor 42 
through an input unit 40. 

A region of interest having a predetermined size 
is then automatically designated on the basis of the 

25 rotation center P. As shown in FIG. 18, the image is 

enlarged according to the screen size of the TV monitor 
42. This makes it possible to observe an image with 
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only a region of interest extracted. Note that a 
region of interest to be automatically set can be 
controlled to an arbitrary shape, size, and the like. 
With this operation, a region of interest corresponding 
5 to the shape of a diagnosis target can be set. 

Subsequently, areas of interest and rotation 
Q centers P are estimated on the remaining images in 

;|| accordance with the contents described above, and each 

o 

Q rotation center P is shifted to the image center. If 

■|S 

l|s 10 the images after shift processing are continuously 

displayed, the region of interest can always be 
:SJ: displayed in the image center. 

L (Example 3) 

An example of designating a region of interest on 
15 a 3D image will be described next. 

First of all, a region of interesting is designed 
on an 3D image on a TV monitor 42 through an input unit 
40. In response to the designation of the region of 
interesting on an 3D image, each of regions of 
20 interesting in 2D images is extracted on the bases of 

the correspondence between the 3D coordinate system and 
the 2D coordinate system. The region of interest that 
is extracted in this manner and has a predetermined 
size is enlarged according to the screen size of the TV 
25 monitor 42, as shown in FIG. 16. 

A rotation center P like the one shown in FIG. 16 
is designated on the region of interest enlarged 
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according to the screen size of the TV monitor 42. 

Note that, the designation of the rotation center 
P also may be executed on the 3D image. In this case, 
the estimation of the rotation center P on 2D images 
5 can be executed according to the correspondence between 

the 3D coordinate system and the 2D coordinate system. 
{SIXTH EMBODIMENT) 

The sixth embodiment of the present invention will 
be described next. 

10 The sixth embodiment can be applied to any of the 

apparatuses according to the first to fifth embodiments 
and is an apparatus having an arrangement that 
facilitates observation in moving image display. 

In the first to fifth embodiments, a moving image 

15 is displayed by continuously displaying all images 

after shift processing. Consequently, in each image, 
even a region other than an observation target 
including a region of interest, i.e., an image region 
of no interest, is displayed. This may cause a 

2 0 deterioration in the power of concentration or 

observation. 

In contrast to this, the apparatus according to 
this embodiment has an arrangement for narrowing a 
display range to display only a predetermined range 
25 from a region of interest in each image. For example, 

this predetermined range may be rectangular or 
circular. With regard to the shape and size of this 
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range, the [Shutter] button is included in a toolbar in 
a display window, and a plurality of types of shapes, 
e.g., a circle and rectangle, are included in a 
pull-down menu corresponding to the button. When a 
5 target shape is selected from these shapes, an image is 

displayed within the selected shape. 

FIG. 19 is a schematic view showing a blood vessel 
displayed as a moving image when a square is selected. 
As shown in FIG. 19, an unnecessary region is masked, 

10 the blood vessel is displayed in the image center. 

This allows the operator to observe the image with high 
power of concentration and observation without moving 
the viewpoint. 

Note that when a shape is selected, another window 

15 is displayed, and the size of the shape can be 

designated in this window. For example, a default 
value (e.g., 1/2 the matrix size) is set as the size of 
a predetermined region. This value can be 
increased/decreased by directly rewriting it or 

20 pressing the up/down key. In this case, the designated 

frame (only the frame line) is preferably superimposed 
on the image to clearly show a predetermined range. 



